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Abstract- This paper considers a group of mobile autonomous agents moving in 
Euclidean space with point mass dynamics. We introduce a set of coordination control 
laws that enable the group to generate the desired stable flocking motion. The control laws 
are a combination of attractive/repulsive and alignment forces. By using the control laws, 
all agent velocities asymptotically approach the desired velocity, collisions can be avoided 
between agents, and the final tight formation minimizes all agent potentials. Moreover, 
we prove that the velocity of the center of mass is always equal to the desired velocity or 
exponentially converges to the desired value. Furthermore, we study the motion of the 
group when the velocity damping is taken into account. In this case, we can properly 
modify the control laws to generate the same stable flocking motion. Finally, for the 
case that not all agents know the desired final velocity, we show that the desired flocking 
motion can still be obtained. Numerical simulations are worked out to illustrate our 
theoretical results. 
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1 Introduction 



Flocking motion can be found everywhere in nature, e.g., flocking of birds, schooling 
of fish, and swarming of bees. Such collective behavior has certain advantages such as 
avoiding predators and increasing the chance of finding food. The study of collective 
emergent behavior of multiple mobile autonomous agents has attracted much attention 
in many fields such as biology, physics, robotics and control engineering. Understanding 
the mechanisms and operational principles in them can provide useful ideas for devel- 
oping distributed cooperative control and coordination of multiple mobile autonomous 
agents/robots. Recently, distributed control/coordination of the motion of multiple dy- 
namic agents/robots has emerged as a topic of major interest PQ [I]. This is partly due 
to recent technological advances in communication and computation, and wide appli- 
cations of multi-agent systems in many engineering areas including cooperative control 
of unmanned aerial vehicles (UAVs), scheduling of automated highway systems, coor- 
dination/formation of underwater vehicles, attitude alignment of satellite clusters and 
congestion control of communication networks [H] [B]- There has been considerable effort 
in modelling and exploring the collective dynamics, and trying to understand how a group 
of autonomous creatures or man-made mobile autonomous agents/robots can cluster in 
formations without centralized coordination and control [§] |25|. 

In order to generate computer animation of the motion of flocks, Reynolds [Hj modelled 
a flying bird as an object moving in three dimensional environment based on the positions 
and velocities of its nearby flockmates, and introduced the following three rules (named 
steering forces) Pj: 

1) Collision Avoidance: avoid collisions with nearby flockmates, 

2) Velocity Matching: attempt to match velocity with nearby flockmates, and 

3) Flock Centering: attempt to stay close to nearby flcokmates. 

Subsequently, Vicsek et al. [TU] proposed a simple model of autonomous agents (i.e., points 
or particles). In the model, all agents move at a constant identical speed and each agent 
updates its heading as the average of the heading of itself with its nearest neighbors plus 
some additive noise. Moreover, the authors used numerical simulations to demonstrate 
that all agents eventually moved in the same direction, despite the absence of centralized 
coordination and control. In fact, Vicsek's model can be viewed as a special case of 
Reynolds's model, since it only considers the regulation of velocity matching. Jadbabie 
et al. JT] and Savkin used two different methods to provide theoretical explanations 
for the observed behaviors in Vicsek's model. Stimulated by the simulation results in [Hj, 
Tanner et al. PHI JI] considered a group of mobile agents moving on the plane with 
double integrator dynamics. They introduced a set of control laws that enable the group 
to generate stable flocking motion, and provided theoretical justification. Nevertheless, 
it is perhaps more reasonable and realistic to take the agents' masses into account and 
consider the point mass model in which each agent moves in high-dimensional space 
based on the Newton's law. From ^H], it is easy to see that, by using the control laws 
given in ^j, the group's final velocity relies solely on the initial velocities of all agents 
in the group. This means that these control laws cannot regulate the final speed and 
heading of the group. On the other hand, in reality, the motion of the group sometimes 
is inevitably influenced by some external factors. Hence, it is not enough to consider 
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only the interactions among agents. In some cases, the regulation of agents has certain 
purposes such as achieving desired common speed and heading or arriving at a desired 
destination. Therefore, the cooperation/coordination of multiple mobile agents with some 
virtual leaders is an interesting and important topic. There have been some papers dealing 
with this issue in the literature. For example, Leonard and Fiorelli [Tj viewed reference 
points as virtual leaders used to manipulate the geometry of autonomous vehicle group 
and direct the motion of the group. [20] and ^T] considered the cohesion/coordination of 
a group of mobile autonomous agents following an actual leader by the so-called nearest 
neighbor rules. 

In this paper, we investigate the collective behavior of multi-agent systems in n- 
dimensional space with point mass dynamics. By viewing the external control signals 
(or "mission") as virtual leaders, we show that all agents eventually move ahead at a 
desired common velocity and maintain constant distances between them. During the 
course of motion, each agent is influenced by the external control signal and the motion 
of other agents in the group. In order to generate the desired stable flocking, we in- 
troduce a set of control laws such that each agent regulates its position and orientation 
based on the desired velocity and the information of a fixed set of "neighbors". The 
control laws are a combination of attractive/repulsive and alignment forces. By using the 
control laws, all agent velocities asymptotically approach the desired value, collisions can 
be avoided between agents, and the final tight formation minimizes all agent potentials. 
One salient feature of this paper is that the self-organized global behavior is achieved via 
local feedback, i.e. the desired emergent dynamics is produced through local interactions 
and information exchange between the dynamic agents. 

This paper is organized as follows: In Section 2, we formulate the problem to be 
investigated. Some basic concepts and results in graph theory are provided in Section 3. 
By using some specific control laws, we analyze the system stability, the motion of the 
center of mass (CoM), and the convergence rate of the system in Section 4. We present 
some different control laws that can also generate the desired stable flocking motion in 
Section 5. For the case that not all agents know the desired velocity, we introduce a set 
of control laws and study the system stability in Section 6. Some numerical simulations 
are presented in Section 7. Finally, we briefly summarize our results in Section 8. 



2 Problem Formulation 

We consider a group of N agents moving in an n- dimensional Euclidean space, each has 
point mass dynamics described by 

x l = v\ ,^ 
nriiV 1 = u\ i = 1, • • • , N, 

where x % = (x\, • • • , x l n ) T G R n is the position vector of agent i, v l = (v[, • • • , v l n ) T G R n is 
its velocity vector, m« > is its mass, and u l = (u\, ■ ■ ■ ,u l n ) T G R n is the (force) control 
input acting on agent i. x % i = x % — x J denotes the relative position vector between agents 
i and j. 

Our objective is to make the entire group move at a desired velocity and maintain 
constant distances between the agents. Additionally, we choose the control laws such 
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that, during the course of motion, collisions can be avoided between agents, and the group 
final configuration minimizes all agent potentials. In what follows, we will investigate the 
motion of the agent group in two different cases, that is, we consider the group motion in 
ideal case (i.e., velocity damping is ignored) and nonideal case, respectively. For the two 
different cases, we propose two different control laws such that the entire group moves at 
a desired common velocity, and at the same time, collision-free can be ensured between 
agents, and the group final configuration minimizes all agent potentials. 

We first consider the ideal case, that is, we ignore the velocity damping. In this case, 
in order to achieve our objective, we try to regulate each agent velocity to the desired 
velocity, reduce the velocity differences between agents, and at the same time, regulate 
their distances such that their potentials become minimum. Hence, we choose the control 
law u l for agent % to be 



where a 1 is used to regulate the potentials among agents, f3 l is used to regulate the velocity 
of agent % to the weighted average of its flockmates, and 7* is used to regulate the mo- 
mentum of agent % to the desired final momentum (all to be designed later), a 1 is derived 
from the social potential fields which is described by artificial social potential function V 1 , 
a function of the relative distances between agent i and its flockmates. Collision-free and 
cohesion in the group can be guaranteed by this term, ff reflects the alignment or velocity 
matching with neighbors among agents. 7* is designed to regulate the momentum among 
agents based on the external signal (the desired velocity). By using such a of momentum 
regulation, we can obtain the explicit convergence rate of the CoM of the system. 

Remark 1: The design of a 1 and j3 l indicates that, during the course of motion, agent 
i is influenced only by its "neighbors", whereas 7* reflects the influence of the external 
signal on the agent motion. 

Certainly, in some cases, the velocity damping can not be ignored. For example, 
objects moving in viscous environment and mobile objects with high speeds such as su- 
personic aerial vehicles, are subjected to the influence of velocity damping. Then, in this 
case, the model should be in the following form 



where h L > is the "velocity damping gain", — k^v 1 is the velocity damping term, and u l 
is the control input for agent i. Here we assume that the damping force is in proportion 
to the magnitude of velocity. Moreover, since the "velocity damping gain" is determined 
by the shape and size of the object, the property of the medium and some other factors, 
we assume that the damping gains fcj, % — 1, • • • , N are not equal to each other. In order 
to achieve our objective, we need to compensate for the velocity damping. Hence, we 
modify the control law u l to be 



u l = a l + (3 l + Y, 



(2) 



rriiV 1 = u % — kiV 1 , 



(3) 



u l = a l + f3 l + Y + fay 1 . 



(4) 
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3 Main Results 



In this section, we investigate the stability properties of multiple mobile agents with point 
mass dynamics described in We will present explicit control input in (J2J) for the terms 
a 1 , f3 % , and 7*. We will employ algebra and graph theory as basic tools for our discussion. 
Some concepts and results in graph theory are given in the Appendix. 

Following [THj . we make the following definitions and assumptions. 

Definition 1 [T^J: (Neighboring graph) The neighboring graph, Q = (V, £), is an 
undirected graph consisting of 

i) a set of vertices, V = {ni, ■ ■ ■ , njv}, indexed by the agents in the group, and 

ii) a set of edges, £ = {(ni,rij) G V x V\rij ~ r^}, containing unordered pairs of 
vertices that represent the neighboring relations. 

In this paper, we consider a group of mobile agents with fixed topology. We assume 
that the neighboring graph Q is connected, and hence does not change with time. Denote 
the set Mi = ' ~ i} C {1, • • - , iV}\{z} which contains all neighbors of agent i. If agent 
j is not a neighbor of agent i, we denote j 00 i. 

Definition 2 [T^j: (Potential function) Potential V 1 ^ is a differentiable, nonnegative, 
radially unbounded function of the distance ||a; y '|| between agents % and j, such that 

i) ^'(ll^ll) -> 00 as H^'ll -> 0, 

zi) y u attains its unique minimum when agents i and j are located at a desired 
distance. 

Functions , i, j = 1, ■ ■ ■ , N are the artificial social potential functions that govern 
the interindividual interactions. Cohesion and separation can be achieved by artificial 
potential fields jH]- In fact, cohesion can be ensured by the connectivity of the neighboring 
graph, but collision-free can only be guaranteed between interconnected agents. Collision 
can be avoided between all agents only when the neighboring graph is complete. 

By the definition of V l \ the total potential of agent i can be expressed as 

V*=£v«(||s*||). (5) 

Agent dynamics in ideal case is different from that in nonideal CclSG, 1.6. ? cl gents have 
different motion equations in the two cases. Hence, in what follows, we will discuss the 
motion of the agent group in two different cases, respectively. 

Note that, in this section, we always assume that all agents can receive the external 
signal, that is, they all know the desired final velocity. In the case that not all agents 
know the mission, we will discuss the flocking control problem in a separate section. 

3.1 Ideal Case 

In this case, we take the control law u l for agent i to be 

u i = ~J2 <%k - V s ) - v ^ - m ^ vl - A ( 6 ) 

where v € R n is the desired common velocity and is a constant vector, Wij > 0, Wij = Wji, 
and Wu = 0, i, j = 1, • • • , N represent the interaction coefficients. And > if agent j 
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is a neighbor of agent i, and is otherwise. We denote W = [wtj]. Thus, W is symmetric, 
and by the connectivity of the neighboring graph, W is irreducible. 



3.1.1 Stability Analysis 

Before presenting the main results of this paper, we first prove an important lemma. 
Lemma 1: Let A G R nxn be any diagonal matrix with positive diagonal entries. Then 

(Aspan{l} ± ) n span{l} = 0, 

where 1 = (1, • • • , 1) T G R n , span{l} is the space spanned by the vector 1, and spanjl} 1 - 
is the orthogonal complement space of spanjl}. 

Proof: Let p G (Aspanjl}- 1 ) flspanjl}. Then p G span{l} and there is some q G 
spanjlj-^ such that p = Aq. It follows that q T Aq = q T p = 0. Since A is positive definite 
by assumption, we have q = and hence p = 0. □ 

Theorem 1: By taking the control law in (JHJ), all agent velocities in the group de- 
scribed in (PJ asymptotically approach the desired common velocity, collision-free is en- 
sured between neighboring agents, and the group final configuration minimizes all agent 
potentials. 

This theorem becomes apparently true after Theorem 2 is proved, so we proceed to 
present Theorem 2. 

We define the following error vectors: 

e* = x l - v°t, (7) 



4 = v* - v°, (8) 

where t is time variable and v° is the desired common velocity. e l p represents the relative 
position vector between the actual position of agent i and its desired position, e* repre- 
sents the velocity difference vector between the actual velocity and the desired velocity of 
agent i. It is easy to see that e l p = e l v , and e\ = if . Hence, the error dynamics is given by 



p 1 — p 1 

°p Si 



M = -L w *, i = 1, • ■ ■ , N. 

v mi ' ' 



(9) 



By the definition of V % \ it follows that 

V ij (\\x ij \\) = V ij (\\ei j \\) := V ij 



where e l J = e p — e p , and hence V % = V 1 and V e iV % ^ = V^V^. Thus, the control input for 
agent % in the error system has the following form 

«' = - E - <) - E v 4^' - m *<- ( 10 ) 

Consider the following positive semi-definite function 

i=i 
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It is easy to see that J is the sum of the total artificial potential energy and the total 
kinetic energy of all agents in the error system. Define the level set of J in the space of 
agent velocities and relative distances in the error system 

n={(eieV)\J<c}. (12) 

In what follows, we will prove that the set Q is compact. In fact, the set {e* , e l J} with J < c 
(c > 0) is closed by continuity. Moreover, boundedness can be proved by connectivity. 
More specifically, from J < c, we have V 1 ^ < c. Moreover, since the potential function 
V % i is radially unbounded, is also radially unbounded, and there is a positive constant 
dij such that \\e z J\\ < d^. Denote d = maxdy. Since the neighboring graph is connected, 

there must be a path connecting any two agents i and j, and its length does not exceed 
N — 1. Hence, we have \\e^\\ < (N — l)d. By similar analysis, we have e l Je l v < 2c/ mi, 
thus ||e*|| < \J2~c[mi. 

By the symmetry of with respect to e l J and by eg = —e ] p \ it follows that 



8V ij dV ij dV ij 



de P J de\, H 



(13) 



and therefore 

N , N 



d 

It ^2 



V 1 -e. 



Theorem 2: By taking the control law in (|10p. all agent velocities in the system de- 
scribed in (jnj) asymptotically approach zero, collision-free is ensured between neighboring 
agents, and the group final configuration minimizes all agent potentials. 

Proof: Choosing the positive semi-definite function J defined as in (J11J) and calcu- 
lating the time derivative of J along the solution of the error system Q, we have 



N N 



j = - Yl J2 w ^v{< - 4) - ™* e f 4 (U ) 

i=l jehfi i=l ^ ' 

= -e T u (L <g> I n )e v - e T v [M ® I n )e v , 

where e v = (eJ T , ■ ■ • , e^ T ) T is the stack vector of all agent velocity vectors in the error 
system; L = [lij] with 

hj = { y^iV*" • ^ ^' (15) 

M = diag(mx, • • • , m^f); I n is the identity matrix of order n and ® stands for the Kro- 
necker product. 

By the definition of matrix L, it is easy to see that L is symmetric, each row sum is 
equal to 0, the diagonal entries are positive, and all the other entries are nonpositive. By 
matrix theory [2Z], all eigenvalues of L are nonnegative. Hence, matrix L is positive semi- 
definite. By the connectivity of the neighboring graph and the symmetry of matrix L, it 
follows that L is irreducible and the eigenvector associated with the single zero eigenvalue 
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is ljv- On the other hand, it is known that the identity matrix I n has an eigenvalue fi = 1 
of n multiplicity and n linearly independent eigenvectors 



V 



' 1 " 




' " 







1 




, P 2 = 













p" 
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By matrix theory |27| . the eigenvalues of L ® J„ are nonnegative, A = is an eigenvalue 
of multiplicity n and the associated eigenvectors are 



[P 



IT 



lTiT 



Furthermore, it is easy to see that matrix M is positive definite and hence — e^[M <g)I n )e v < 
0. Thus J < 0, and J = implies that el = el = ■ ■ ■ = and they all must equal zero. 
This occurs only when v 1 = v 2 = ■ • ■ 



t>°, that is, the vector e 



vk 



■'vki 



e N ) 

(A; = 1, • • • , n), which is composed of all the corresponding kth components el k , ■ ■ ■ ,e^ k 
of el, ■ • • , e^, is contained in span{l}, where 1 = (1, • ■ ■ , 1) T G R N and each entry e l vk of 
e^fc equals zero. It follows that & = 0, V(i,j) & N x N. 

We use LaSalle's invariance principle |2H1 to establish convergence of the system tra- 
jectories to the largest positively invariant subset of the set defined by E = {e v \J = 0}. 
In E, the agent velocity dynamics in the error system is 



t = —u* = -— Y V e * V ij = -—V e i V* 
rrii rrii z — 4 v p 



and therefore it follows that 



e v = —((M~ l B) <g> I n 



ViiV l: > 



(16) 



where M 1 = diag(— , • • • , — ) is the inverse of matrix M, and matrix B is the incidence 
matrix of the neighboring graph. Hence 

e vk = -{M- l B)[V e ^V i % k=l,---,n. 

Thus, e v k G range(M _1 I?), k = 1, ■ ■ ■ ,n. By matrix theory and by the connectivity of 
the neighboring graph Q, we have 

range(M _1 J B) = M _1 rangeS = M _1 range( J B J B T ) = M^^panjl}" 1 

and therefore 



e v t G M 1 span{l} ± , k — 1, • • • , n. 
In any invariant set of E, by e v k G span{l}, we have 

e vk G span{l}. 



(17) 
(18) 
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Furthermore, by Lemma 1, we get from (|17j) and (|18jl that 

e vk G (M" 1 span{l} ± ) n span{l} = 0, k = 1, • • • , n. 

Thus, in steady state, all agent velocities in the error system no longer change and equal 
zero, and moreover, from the potential V 1 of each agent i is minimized. Collision-free 
can be ensured between neighboring agents since otherwise it will result in V 1 — > oo. □ 

From the proof of Theorem 2, it follows that, in steady state, all agent actual velocities 
no longer change and are equal to the desired velocity. 

Remark 2: Only when the neighboring graph is complete, collision avoidance between 
all agents can be guaranteed with the control laws above. 

Remark 3: If we take the control law for agent % to be 

u < = - v*) - - - v°), (19) 

we can also get the same conclusion as in Theorem 1. Here, we still consider the error 
system ©. In fact, if we take the same Laypunov function J defined as in Theorem 2 
and take the control law in (|19|). we obtain that 

j = ~e T v (L <g> I n )e v - e T v {M <g> I n )e v , 

where L = A— A is the Laplacian matrix of the neighboring graph, A = diag(iVi, • • • , N^), 
Ni denotes the valance of vertex % in the graph, and A is the adjacency matrix of the 
graph. Using a similar analysis method as in Theorem 2, we can obtain the same conclu- 
sion of stable flocking. Note that, in comparison with Theorem 2, we have the following 
difference on the decaying rates of the energy function J 

-el(L <g> I n )e v + el(L <g> I n )e v = -eJ(L <8> I n )e v , 

where L = [Zy] with 

{— + 1, i ^ j and j ~ i, 

i j and j ^ i, 

J2k=l,k^i w ik ~ N i, i=3- 

It is easy to see that, by using the different control laws in (jHJ) and (fT9"|) . the decaying 
rates of the total energy J may be different. Hence, the interaction coefficients Wij can 
influence the convergence rate of the system. 

3.1.2 The Motion of the Center of Mass 

In what follows, we will analyze the motion of the center of mass (CoM) of system (0). 
The position vector of the CoM in system ((TJ) is defined as 

i 
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Thus, the velocity vector of the CoM is 



* _ Ei=i m i v 
Et=i m * 

By using control law (JOJ), we obtain 

w ij( vl - vj ) + Yl + m ^ vi - ■ 

By the symmetry of matrix W and the symmetry of function V % i with respect to , we 
get 

i>* = -v* + v°. (20) 
Suppose the initial time t = 0, and v*(0) — Vq. By solving (J2*UJ| . we get 

v * = w ° + („J - v 0) e -*. 

Thus, it follows that, if Vq = v°, then the velocity of the CoM is invariant and equals v° 
for all the time; if Vq 7^ v°, then the velocity of the CoM exponentially converges to the 
desired velocity v° with convergence exponent 1. 

Therefore, from the analysis above, we have the following theorem. 

Theorem 3: By taking the control law in (|BjL if the initial velocity of the CoM is equal 
to the desired velocity, then it is invariant for all the time; otherwise it will exponentially 
converge to the desired velocity. 

Remark 4: Note that, by the calculation above, we can see that the velocity variation 
of the CoM does not rely on the neighboring relations or the magnitudes of the interaction 
coefficients. Even if the neighboring graph is not connected, the velocity of the CoM still 
equals the desired velocity or exponentially converges to it, and the final velocities of 
all connected agent groups equal the desired velocity as well. However, in this case, the 
distance between disconnected subgroups might be very far. 

3.1.3 Convergence Rate Analysis 

From the discussion above, we know that the coupling coefficients can influence the con- 
vergence rate of system (0). In what follows, we will present some qualitative analysis of 
the influence of the weights on the convergence rate of the system. 

Let us again consider the dynamics of the error system. From the analysis in Theorem 
2, we know that J < 0, and J = occurs only when el = ef, = ■ ■ ■ = = 0, that is, 
only when all agents have reached the desired velocity. In other words, if there exists 
one agent whose velocity is different from the desired velocity, then the energy function 
J is strictly monotone decreasing with time. Of course, before the group forms the final 
tight configuration, there might be the case that all agent velocities have reached the 
desired value, but due to the regulation of the potentials among neighboring agents, it 
instantly changes into the case that not all agents have the desired velocity. Hence, the 
decaying rate of energy is equivalent to the convergence rate of the system. It is easy to 
see that, when not all agents have reached the desired velocity, for any solution of the error 
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system, e v must be in the subspace spanned by the eigenvectors of L ® I n corresponding 
to the nonzero eigenvalues. Thus, from (fTi|) . we have J < —\2€^e v — e^(M ® I„)e„, 
where A2 denotes the second smallest real eigenvalue of matrix L. Therefore, we have the 
following conclusion: The convergence rate of the system relies on the second smallest 
real eigenvalue of matrix L defined as in ()15|) as well as agent masses, and it is always not 
faster than the convergence rate of the CoM. Furthermore, if the initial velocity of the 
CoM is not equal to the desired velocity, then the fastest convergence rate of the system 
does not exceed the exponential convergence rate with convergence exponent 1. 

Remark 5: Note that when the group has achieved the final steady state, the control 
input above equals zero. 

3.2 Nonideal Case 

Sometimes, the velocity damping should not be ignored. Then, in this case, in order to 
make the group generate the desired stable flocking motion, the velocity damping need 
to be cancelled by some terms in the control laws. Hence, we modify the control law as 
in (JH), where a 1 , /?*, and Y are defined as in (JHJ), that is, the control law acting on agent 
i is 

U l = - Wijiv* - V j ) - - m *(^ - V °) + k i yl - ( 21 ) 

Then, the total force acting on agent % is 

u * = - Yl - J) - E v ^ - m ^ yi - A 

All the results in ideal case can be analogously extended to the nonideal case. Namely, 
following Theorems 1 and 2, we can easily obtain the desired stable flocking motion, 
that is, when the velocity damping is taken into account, by using control law (J2TJ), all 
agent velocities in the group described in asymptotically approach the desired value, 
collision-free can be ensured between neighboring agents, and the group final configuration 
minimizes all agent potentials. Furthermore, following Theorem 3 and the convergence 
rate analysis above, we conclude that the convergence rate of the system relies on the 
interaction coefficients and agent masses, and when the initial velocity of the CoM is not 
equal to the desired velocity, the fastest convergence rate of the system does not exceed 
the exponential convergence rate with convergence exponent 1. 

Note also that, because the velocity damping is concelled by some terms in the control 
law, the velocity damping cannot influence the convergence rate of system (JHJ). 

Remark 5: In steady state, the group keeps on moving at a desired velocity. During 
this period, the control laws' role is only to cancel the velocity damping. 

4 Discussions on Various Control Laws 

In the sections above, we introduced a set of control laws that enable the group to generate 
the desired stable flocking motion. However, it should be clear that control law © is not 
the unique control law to produce the desired motion for the group. In this section, we 
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provide some more useful control laws. For simplicity, we only present the control laws 
for the group moving in the ideal case, since in the nonideal case, we only need to add 
the terms kjV 1 (i = 1, • • • , N) to cancel the velocity damping. 

In the sequel, we will propose three different control laws that can achieve our control 
objective. The analysis and proofs are quite similar for these control laws, so we only 
present the control laws and their corresponding Lyapunov functions. 

1) In the control laws above, 7* is used to regulate the momentum of agent %. However, 
we can also use Y to directly regulate the velocity of agent i to the desired value. Hence, 
we take the control law acting on agent i to be 

u l = - ~ v j ) - ~ ( u< ~ A ( 22 ) 

We still consider the error system © and choose Lyapunov function By similar 
calculation, we get 

j = -e„(L <g> I n )e v - e r v e v . 

Using the same analysis method as in Theorem 2, we obtain that J < 0, and J = 
implies that = = ■ ■ • = = 0. The rest analysis is similar to Theorem 2, thus is 
omitted. 

Remark 6: Note that, the control law in ()22j) can make the group generate the 
desired stable nocking motion. But we cannot explicitly estimate the convergence rate of 
the CoM by using this control law. 

2) Suppose that a % and (3 l rely on agent z's mass. The control law acting on agent i 
has the following form 

-rriiiy'-v ). (23) 

In this case, for the error system (JHJ), we choose the following Lyapunov function 

1 N 

J =2^{ Vl + • (24) 

i=i 

By similar calculation, we have 

j = -el{L <g> I n )e v - ele v . 

Following the analysis method in Theorem 2, we can show that the desired stable flocking 
motion will be achieved. 

Definition 3: Define the center of the system of agents as x = (X)i=i x l )/N. 

Definition 4: The average velocity of all agents is defined as v = (YliLi v l )/N. 

It is obvious that the velocity of the system center is just the average velocity of all 
agents. 

Using the control law in (|23*j) . we have v = —v + v°. Suppose the initial time to = 
and U(0) = v®. We get 

v = v° + {v - v°)e-\ 
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It is obvious that, if vq = v°, then the velocity of the system center is equal to the 
desired velocity v° for all the time, and if vo 7^ v°, then the velocity of the system center 
exponentially converges to the desired velocity with convergence exponent 1. 

3) Suppose that a % and (3 l rely on agent i's mass, and Y is used to regulate the velocity 
of agent % to the desired velocity. The control law u l is then taken to be 

(v l -v°). (25) 

jeJVi jeJVi 

We consider the error system (jHJ) and choose the corresponding Lyapunov function 
(J23). Then, 

j = -el{L ® I n )e v - e^M" 1 ® I n )e v , 

where M~ l is the inverse of matrix M. The rest analysis is similar, thus is omitted. 

Remark 7: Note that, using the control law in (|25|). the convergence rates of the 
CoM and the system center both cannot be explicitly estimated. 

From the analysis above, we conclude that the control law in (j^J) is the best one among 
the various control laws. On the one hand, control law © can be given certain physical 
explanations, on the other hand, the corresponding Lyapunov function has certain physical 
meaning. More importantly, by using the control law in (JB|). the convergence rate of the 
CoM of the system can be accurately estimated. 



5 Extensions and Discussions 

In this section, we investigate the case that not all agents know the desired velocity. We 
assume that the neighboring graph is connected and the neighboring relations are fixed. 

We first divide the group into two subgroups. Subgroup One consists of all agents that 
can detect the reference signal, i.e., all agents who know the desired velocity belong to 
Subgroup One. Subgroup Two contains all agents that can not detect the reference signal. 
Hence, each agent in Subgroup One regulates its state based on the reference signal and 
the information of its "neighbors", whereas each agent in Subgroup Two regulates its 
state only based on its "neighbors" . 

We assume that there exists at least one agent who knows the desired velocity. In the 
case that there is no external signal acting on the group, the collective dynamic behaviors 
of the agent group have been analyzed in [To] . 

Without loss of generality, suppose that agent i (i = 1, • • • ,Ni) (1 < Ni < N) are 
contained in Subgroup One, and agent j (j — Ni + 1, • • • , N) are contained in Subgroup 
Two. The control law acting on agent i in Subgroup One is taken to be 

ul = - E w ^ vl - vk ) - E v ** yik - m ^ v% - 

fceAA keAfi 
and the control law acting on agent j in Subgroup Two is taken to be 
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We can lump the two equations above into one 

u* = -^2 wutf - v j ) - - h i m i( vi - v °) ( 26 ) 

for i = 1, • ■ ■ , N, where hi is defined as 

, f 1, if agent i is contained in Subgroup One, 
\ 0, if agent % is contained in Subgroup Two. 

We still consider the error system JOJ). Using control law (|2l))l and taking Lyapunov 
function (fTT|) . we have 

j = -el{L ® I n )e v - el(M®I n )e v , 

where L, e l v , and I n are defined as before, M = diag(/iimi, • • • , hum^). By the definition 
of hi and rrii, it follows that matrix M is positive semi-definite. Following similar analysis 
as in the previous sections, we can conclude that the desired stable flocking motion can 
be achieved. 

Remark 8: If there exists only one agent in the group who can detect the external 
reference signal, the group can still generate the desired stable flocking motion. This is 
of practical interest in control of multi-agent systems. 

Remark 9: Even if only one agent in the group cannot detect the external reference 
signal, it is difficult to explicitly estimate the convergence rate of the CoM. 

It should be noted that there is no actual leader among agents, all agents play the 
same role. However, we can view the external reference signal as a virtual leader. 

The results in this section suggest that, if we want to control a group of mobile 
agents to move at a given velocity, we only need to send our mission signal to any one of 
them. Then the signal can be propagated through the neighboring interactions. This is 
of practical interest in control of multiple mobile robots or a large population of animals 
(think how do you pass through a crowds of people? and how the shepherding dog steer 
a large group of sheep back home?). 

6 Simulations 

In this section, we will present some numerical simulations for the system described by 
(JTJ) in order to illustrate the theoretic results obtained in the previous sections. 

These simulations are performed with ten agents moving on the plane whose initial 
positions, velocities and the neighboring relations are set randomly, but they satisfy: 1) 
all initial positions are set within a ball of radius R = 15 [m] centered at the origin, 2) 
all initial velocities are set with arbitrary directions and magnitudes within the range of 
(0, 10)[m/s], and 3) the neighboring graph is connected. All agents have different masses 
and they are set randomly in the range of (0, l)[kg]. 

The following simulations are all performed with the same group, and the group has the 
same initial state, including all agent initial positions, velocities, and the fixed neighboring 
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relations between agents. However, different control laws are taken in the form of (jOJ) or 
(J2*H|) with the explicit potential function 

V ij = 5hi\\x ij \\ 2 + -rr-^, i, j = 1, • • • ,10. 
ii ii ||x^|| 2 

The interaction coefficient matrix W is generated randomly such that wu = 0, Wij = 
Wji, and the nonzero satisfy < < 1 for all i, j = 1, ■ • ■ , 10. We run all simulations 
for 250 seconds. 

Fig. 1 presents the group initial state including the initial positions and velocities of 
all agents, and the neighboring relations between agents. Figs. 2-4, 5-7 and 8-10 show 
the motion trajectories of all agents, the final configurations of the group, and all agent 
velocities in three different simulations, respectively. Figs. 11 and 12 depict the motion 
trajectories of the CoM in the three simulations, whereas Figs. 13 and 14 are the velocity 
curves of the CoM. Note that, in the velocity curve figures, the solid arrow indicates the 
tendency of velocity variation, and the meanings of the other arrows, dashed lines, and 
solid lines are all presented in the figures. 

In Fig. 1, the solid lines represent the neighboring relations and the dotted arrows 
represent the initial velocity vectors. Figs. 2-4 describe the group state in the case that 
the motion of the group is not influenced by any external signal and only relies on the 
interactions between agents. It can be seen from them that, during the course of motion, 
all agents regulate their positions to minimize their potentials, regulate their velocities to 
reduce the differences , and move ahead with a steady state configuration. Moreover, the 
final common velocity is equal to the initial velocity of the CoM of the system. 

When we send a signal to the group and try to make all agents move at a desired 
velocity, Figs. 5-7 show the results in our simulation with the control laws taken in the 
form of (jBJ), whereas Figs. 8-10 show the simulation results with the control laws taken 
in the form of (|2fij) and with the assumption that there is only one agent who knows 
the desired velocity. It can be seen from them that all agents regulate their positions to 
minimize their potentials and eventually move ahead with a steady state configuration. 
Figs. 7 and 10 are the velocity curves, and they distinctly demonstrate that all agent 
velocities asymptotically approach the desired velocity. 

Note that the final configurations of the group are different in the three simulations. 
This is because, during the course of motion, each agent regulates its position only based 
on the information of its "neighbors" in the group, hence collisions cannot be avoided 
between the agents having no neighboring relations. 

Fig. 11 shows the motion trajectories of the CoM in the simulations where the star 
represents the initial position of the CoM, and Fig. 12 is the magnification of the trajec- 
tories of the CoM at the initial time. Fig. 13 shows the velocity curves of the CoM where 
the star represents the initial velocity of the CoM, and Fig. 14 is the magnification of the 
velocity curves of the CoM at the initial time. In these four figures, (a), (b), and (c) rep- 
resent the corresponding states of the CoM in the three simulations, respectively. It can 
be seen from them that, when there is no external signal acting on the group, the velocity 
of the CoM is always invariant and is equal to the final common velocity, otherwise, the 
velocity of the CoM converges to the desired velocity. Apparently, the convergence rate 
of the CoM is faster than the convergence rate of the system. 
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Hence, numerical simulations also indicate that, by using the control law in (ffi|) . the 
desired stable flocking motion can be achieved. 

7 Conclusions 

We have investigated the collective behavior of multiple dynamic agents moving in high- 
dimensional space with point mass dynamics, and presented some control laws which 
ensure the group to generate the desired stable flocking motion. The group dynamic 
properties are characterized in two different cases. When the velocity damping is negligi- 
ble, using a set of coordination control laws, we can make the group generate the desired 
stable flocking motion. The control laws are a combination of attractive/repulsive and 
alignment forces, and they ensure that all agent velocities asymptotically approach the 
desired velocity, collisions are avoided between neighboring agents, and the final tight 
formation minimizes all agent potentials. Moreover, we showed that, when the initial 
velocity of the center of mass is not equal to the desired velocity, it will exponentially 
converge to the desired velocity. When the velocity damping is taken into account, we 
can properly modify the control laws in order to generate the desired stable flocking. Sub- 
sequently, we investigated the motion of the group in the case that not all agents know 
the desired final velocity, and showed that the desired stable flocking motion can still be 
achieved by our control laws. Finally, numerical simulations were worked out to further 
illustrate our theoretical results. Our method is general, integrating both algebraic the- 
ory and graph theory, and is applicable to dealing with more complex agent dynamics, 
information topology and interaction mechanisms. 

8 Appendix: Graph Theory Preliminaries 

In this section, we briefly summarize some basic concepts and results in graph theory that 
have been used in this paper. More comprehensive discussions can be found in 

A graph Q consists of a vertex set V = {ni, n 2 , ■ ■ ■ , n m } and an edge set £ = {(rii, rij) : 
ni,rij G V}, where an edge is an unordered pair of distinct vertices of V. If ni,rij G V, 
and (rii, rij) G £, then we say that rij and rij are adjacent or that rij is a neighbor of rij, 
and denote this by writing rij ~ rij. A graph is called complete if every pair of vertices 
are adjacent. The valence of vertex of Q is defined as the number of edges of Q which 
are incident with n*, where an edge is incident with vertex rij if one of the two vertices 
of the edge is rii. The adjacency matrix of Q is an m x m matrix whose r/'th entry is 1 
if (ui,nj) is one of (?'s edges and is if it is not. A path of length r from rii to rij in a 
graph is a sequence of r + 1 distinct vertices starting with n; and ending with rij such 
that consecutive vertices are adjacent. If there exists a path between any two vertices of 
Q, then Q is connected. 

An oriented graph is a graph together with a particular orientation, where the orien- 
tation of a graph Q is the assignment of a direction to each edge, so edge (rii, rij) is an 
directed edge from to rij. The incidence matrix B of an oriented graph Q is the {0, ±1}- 
matrix with rows and columns indexed by the vertices and edges of Q, respectively, such 
that the ij-entry is equal to 1 if edge j is ending on vertex rii, -1 if edge j is beginning 
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with vertex rij, and otherwise. Define the Laplacian matrix of Q as L(Q) = BB T . It 
follows that L(Q) = A — A, where A is the adjacency matrix of undirected graph Q and A 
is a diagonal matrix whose ith diagonal element is the valence of vertex rij in the graph. 
L is always positive semi-definite. Moreover, for a connected graph, L has a single zero 
eigenvalue, and the associated right eigenvector is l m . 
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